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The invention relates to the correction of defects in image sensors, and is 
applicable to digital signal processors, digital still cameras and to digital video cameras. It 
has particular relevance to image sensors for consumer electronics and for medical systems, 
and is suitable for incorporation in a digital signal processor. 

5 

Defects in images can take the form of single pixels, clusters or columns 
which have a small sensitivity difference compared to the rest of the image. A defect pixel 
may have a higher or a lower output signal than its neighboring pixels at the same 
illustration. This can be caused by defects in the sensor itself or by defects on the cover class 

10 of the image sensor that arise because the pixels around the edges of a sensor block will 

generally have lower sensitivity. In case of a big sensor, this sensor has to be built up out of 
different blocks. The signals from these blocks are stitched together. At the borders of these 
blocks the sensors have a slightly different sensitivity than the neighboring pixels. This 
results in a so-called stitch line, which often appears as a visible line dividing the image. For 

15 example, in a known image sensor, a stitch line may appear as a double column with a gain 
difference above 1% and frequently up to 3%. 

EP 0519719 describes a method of reducing edge defects in images generated 
using arrays of pick-up elements. An image splitter is employed to separate the images 
corresponding to adjacent elements in the array so as to reduce the edge effects, 

20 JP-A 61-260773 discloses a defect pixel correction in dependence on a 

plurality of differences across a defect. 

EP-A 0 685 964 discloses a CCD-defect compensating method for a 
camcorder, including the steps of: sequentially delaying input pixel data; operating the values 
of pixels preceding and behind two stages from an nth pixel, and comparing the operated 

25 value with a reference level value to detect the presence or absence of a defect; averaging the 
pixel data two stages preceding and behind the nth pixel having the defect, to thereby obtain 
the nth pixel data; deciding the position of the defect to thereby generate a defect 
compensating control signal; and selectively compensating only for the pixel data averaged in 
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the averaging step or the pixel data having the defect and delayed in the pixel delaying step, 
and outputting the compensated data with the original (externally input) pixel data. 

Defect correction can be accomplished by a correction that uses a (suitably 
weighted) average value of neighboring pixels that are not defect, the so-called average 
5 correction technique that is known to skilled persons in this technical field. However, the 
performance of the average correction technique is not good enough to completely eliminate 
the wide range of possible defects, including stitch lines and clusters, over a wide range of 
circumstances. 



10 It is, inter alia, an object of the invention to improve defect correction in image 

sensors. To this end, the invention provides a defect correction as defined in the independent 
claims. Advantageous embodiments are defined in the dependent claims. 

According to one embodiment of the invention, if the severity of the defect is 
large then average correction is used. If the severity is small, then the defect pixel value is not 

1 5 corrected. For in-between values, the level of good nearby pixels is assessed and the defect 
pixel value is not corrected for relatively small level differences, while the average correction 
is used for relatively large differences. 

These and other aspects of the invention will be apparent from and elucidated 
with reference to the embodiments described hereinafter. 

20 

In the drawings: 

Fig. 1 is a block flow diagram schematically illustrating one embodiment of a 
method according to the present invention; 

Fig. 2 schematically illustrates one stage of the method of Fig. 1; 
25 Fig. 3 schematically illustrates one example applied to another stage of the 

method of Fig. 1; and 

Fig. 4 schematically illustrates another example applied to the stage of Fig. 3. 



In Fig. 1 various stages of one embodiment of the method of the invention are 
30 shown. Level signal LI, level signal L2 and calibration information CD3 are determined in 
dependence upon the application concerned and the customer requirements. Digital Image 
data from a sensor S4 is supplied and pixel sampling is effected at sampler 5. At least two 
and preferably three pixels are sampled on each side of a defect. Differences between the 
intensities of the pixels are then calculated at difference calculator 6. Four difference values 
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Dl, D2, D3, D4 are calculated; two different values Dl, D2 generated by differences in 
intensity across the defect and a difference value D3, D4 relating to each side of the defect. 

The difference signals Dl, D2, and D3, D4 are then compared at comparator 7 
to the level signals LI and L2, respectively. If any one of the difference signals is higher than 
5 its respective level signal then the image scene is categorized as "high frequency*' (AC), but 
if all difference signals are lower than the two level signals then the image scene is 
categorized "low frequency" (DC). This is termed the "DC Test". 

When all the difference signals are lower than the level signals LI and L2, and 
the "DC test" thus results in low frequency (DC), this is considered an even image, and the 
10 average correction technique is employed by averager 8 on the image. 

In a first embodiment, no correction is applied when the image scene around 
the defect is categorized as "high frequency". The following holds for a more advanced 
J embodiment. 

i When the DC test results in high frequency (AC) then the size (severity) of the 

!15 defect is assessed at evaluator 9. If the defect is large (L), for example, when there is no 
1 output signal (= dead pixel), then the average correction technique (8) is again followed. If 
the size of the defect is medium (M), the intensity level of close or adjacent (nearby) good 
pixels is assessed at assessor 10 and, depending upon their value either the average correction 
technique (8) is used when the nearby levels are large (NL), or the defect is not corrected (1 1) 
20 when the nearby levels are small (NS). Finally, if the size of the defect is small (S), no 
correction is applied to the defect pixel value in step 11. 

While a block diagram is shown, each block following the image sensor S4 
may be seen as a method step carried out by an image processor in a software 
implementation. 



25 



Fig. 2 schematically illustrates the calculated difference values. Pixels are 
labeled as a, b, c on one side of a defect cluster DEF and x, y, z on the opposite side. In this 
example the cluster DEF comprises two pixels m, n. The following differences are 
calculated: 



30 Dl 
D2 
D3 
D4 



b-x 
a - c 
x - z 
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Thus Dl and D2 represent differences between pixels on opposite sides of the 
defect cluster DEF whereas D3 and D4 represent the differences between pixels which lie on 
respectively the same sides of the defect DEF. 

5 Fig. 3 shows one particular example applied to the method of the invention. 

The intensities of the pixels a, b, c and x, y, z are represented by the bar graph and the 
differences Dl to D4 are illustrated by the respective arrows which are reproduced in the 
lower graph which also shows the values of level 1 and level 2 for comparison. In this 
example D3 and D4 are above level 2 and thus this image is treated for correction as a "high 
10 frequency" (AC) image. The size of the defect is then assessed. If the size of the defect is 
large then the average correction technique is applied. If the defect is small then no 
correction is done. If the defect is of medium size then the intensity level of good adjacent 
pixels is assessed and either the average correction is used or the defect pixel value is not 
corrected as explained above. 

15 

In Fig, 4 a more even image is used and the frequency is lower. All of the 
difference signals Dl, D2, D3 and D4 are below level 2. This will be treated as low 
frequency (DC), i.e. since it is a relatively even image, and correction will be by way of the 
average correction technique. 
20 This correction method gives a good correction capability across a wide range 

of defects and defect sizes and can substantially reduce or eliminate the small defect lines 
hitherto seen. 

Typical results of the method of the invention are achieved on images of a 
25 checkered shirt. This is a high frequency (AC) image and a stitch line tends to be very 
obvious in such scenes: a 3% small defect column would be typical. When the average 
correction technique is used, the small defect lines are still very evident. When the method of 
the invention is used and level correction (small) is applied with for superior results: the 
small defect line is barely visible. 
30 In a second example, the method of the invention is applied to a scene with 

cluster defects. A raster of 24% clusters in the air and in the grill of a classic car is present in 
the original image. It appeared that the cluster defects in the image, particularly in the grill, 
are substantially reduced by means of the level correction method according to the invention, 
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thus illustrating that the method of the invention can correct rather large clusters which 
previous technologies could not. 

Generally, the levels at which defects are categorized as large, medium or 
5 small is determined during calibration of the device in production. 

It should be noted that the above-mentioned embodiments illustrate rather than 
limit the invention, and that those skilled in the art will be able to design many alternative 
embodiments without departing from the scope of the appended claims. In the claims, any 

10 reference signs placed between parentheses shall not be construed as limiting the claim. The 
word "comprising" does not exclude the presence of elements or steps other than those listed 
in a claim. The word "a" or "an" preceding an element does not exclude the presence of a 
plurality of such elements. The invention can be implemented by means of hardware 
comprising several distinct elements, and by means of a suitably programmed computer. In 

15 the device claim enumerating several means, several of these means can be embodied by one 
and the same item of hardware. The mere fact that certain measures are recited in mutually 
different dependent claims does not indicate that a combination of these measures cannot be 
used to advantage. 



